Quantum-Implemented Selective Reconstruction of 

High-Resolution Images 



o 
o 

(N 

in 



> 



o 
o 

Oh" 



X 
J5 



Mitja Perus & Horst Bischof 
Institute for Computer Vision & Graphics, Graz University of Technology 
Inffeldgasse 16 (2. OG), A-8010 Graz, Austria / {perus, bischof}@icg.tu-graz.ac. at 

Loo Chu Kiong 

Faculty of Engineering and Technology, Multimedia University (Melaka) 
MY-75450 Melaka, Malaysia / ckloo@mmu.edu. my 



Abstract 

This paper proposes quantum image reconstruction. 
Input-triggered selection of an image among many 
stored ones, and its reconstruction if the input is oc- 
cluded or noisy, has been simulated by a computer pro- 
gram implementable in a real quantum-physical system. 
It is based on the Hopfield associative net; the quantum- 
wave implementation bases on holography. The main 
limitations of the classical Hopfield net are much re- 
duced with the new, original - quantum- optical - imple- 
mentation. Image resolution can be almost arbitrarily 
increased. 



1 Introduction 

There is growing evidence that quantum-physical sys- 
tems could be harnessed for information processing, 
including specifically image recognition, in two ways: 

• by Turing-machine-based quantum computing us- 
ing quantum logic gates [3 El H 5 

• by quantum processing similar to those in (oscil- 
latory) associative neural nets (51 (cf. IHICI)- 

This paper reports how it is possible to implement suc- 
cessful image recognition, as verified by our simula- 
tions, in a quantum holographic process 8 . Since the 
natural fundamental quantum-wave dynamics is har- 
nessed, it allows much easier and cheaper physical real- 
ization with much bigger sizes and resolutions of images 
than the mainstream quantum-computing approaches 

The main contribution of this paper is not to pro- 
pose a generally-hettei image-recognition method, but 
to present its powerful alternative implementation into 
a quantum-wave medium (sec. 2), and to demonstrate 
its plausibility by computational experiments (sec. 3). 
Quantum- net's capacities of connectivity, parallelism, 
storage, associativity, speed and miniaturization are 
enormous^ even much greater than in classical holog- 
raphy iQllTn). 



In JT] it was shown how the Hopfield model 
with real-valued (thus not necessarily binary) ac- 
tivities of units / neurons, having linear (not sig- 
moid or signum) activation function, can be trans- 
formed into a quantum-holographic procedure |H1 
where the Hebbian memory-storage is replaced by mul- 
tiple self-interferences of quantum plane- waves. This 
translation succeeded by the simplest variable ex- 
change of the Hopfield's real-valued variables with the 
complex-valued variables changing according to sinu- 
soids (waves) (cf. j6||7|). Thereby, all input-to- output 
transformations are preserved. Thus, quantum-wave 
image recognition functions equivalently to Hopfield's 
one, only the implementation is much miniaturized en- 
abling almost infinitely large neural-like networks. 

Since the opposite translation, i.e. digitalization of 
holography, was done in the sixties of the 20^^ cen- 
tury to get the first computational associative mem- 
ories, one might wonder what is new in the present 
proposal. The big experimental success of classical (op- 
tical, acoustic, microwave- etc., but also X-ray-, atom- 
, electron-) holography [HI is widely known, but not 
also the recent fast development of quantum optics ^Jj 
which gave birth to quantum holography 8 (good "tu- 
torial" in ^Sl)- The latter promises to implement the 
well-known Hopfield model and its generalizations in 
a completely new framework where the former obsta- 
cles (memory-capacity limitations, problems with non- 
orthogonality of small-size inputs producing cross-talk) 
are very much reduced. 

2 Web of quantum waves 

Using neuro-quantum " isomorphisms" , presented sys- 
tematically in ^ni? and " numbers-to- waves" transla- 
tion, as in iT, we transform the Hopfield-like asso- 
ciative neural net into quantum formalism (details in 
lIHEI): 

• Quantum wave- function ^ acts as net's state vec- 
tor q. 

• Eigen- wave- functions ?/^^ (/c = 1, P) act as Hop- 
field's pattern-bearing eigen-vectors (attractors) 



• The quantum Green-function propagator G re- 
places the Hebb memory matrix J. 

• Thus, sum of self-interferences ip^^ip^ of quantum 
waves ip^ (that's the "hologram" G) implements 
the sum of auto-correlations of input-pattern con- 
figurations (that's the content-addressable 
associative memory J). (0 denotes tensor/outer 
product.) 

The Hebb-equivalent expression for elements of G (i.e., 
the multiple cris-cross array tp^ implementing 
matrix J) is: 



see in m].) The image- modulated laser-beam is thus: 
_ (g«^i ^ g«^2 ^ ...^ e*'^^) where the number of wave- 
front points (wave peaks) is A^. 

The "isomorphism" of [TTj allows us to exchange 



variables, 



Ghj 



(1) 



where h and j denote the unit / pixel / "neuron" 
/ quantum point at locations fi and r2 at time t 
{h^j = 1, A^; N can be almost infinite). The aster- 
isk denotes complex conjugation (or, optically, phase 
conjugation). 

After we have succeeded to encode patterns or im- 
ages as eigen-states (attractors) ip^ into the quantum 
system prescribed by eq. (1), we can reconstruct one 
(say, /cq^) by presenting a new input similar to the k^^ 
stored one: 
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describes the resulting selective retrieval (recognition) 
of image v^^ encoded in ip^^ . See detailed analysis in 
[TT] or [5j. Eq. (2) is in analogy with |18|. In the 
quantum Dirac notation, eq. (2) is, using (a (g) b)c = 
(6, c)a: 



(3). 



e*'^, giving ip: 



instead of 



Hopfield-like ipj = Vj (or ipj = A^, respectively). 
With this exchange in equations (1) and (2), all the 
information-processing mathematics, verified by com- 
puter experiments of sec. 3 and 15 , remains valid for 
sinusoid-encoded images also. Namely, because eq. (1) 
becomes 
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eq. (2) becomes 
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(6). 



If images are almost orthogonal, a wave carrying an 
image (those among many stored ones which is the 
most similar to the newly input one) is selectively re- 
constructed. 

There is a non-local information-exchange involved 
in this holographic process, which in our quantum case 
exploits the quantum interference web (G) itself, not 
its static imprint onto a crystal plate as in classical 
holography 9 . 

Our information-processing result can be extracted 
from ip^^ using new quantum-optical (and computer- 
aided) techniques for "ensemble" -measurement of ob- 
servables or for quantum- holographic- (like) wavefront 
reconstruction 14 : 

• quantum-phase estimation / engineering, 

• wave-packet / wave-function reconstruction / sculpt- 
ing / engineering, 

• (coherent) quantum control / manipulation, 

• quantum tomography. 



We assume that we can encode images into 
quantum plane waves (i.e., propagating sinusoidally- 
changing probability-distribution for measuring a pho- 
ton ^ at location r at time t): 

^^{r,t) = A^(r,t)e^^'("^'^) = A^ei^p'^'^''^ (4). 

We may choose the same constant amplitudes A, so 
that quantum phases (delays between wave-peaks) cp 
encode the whole information. Let us take A = 1 (or 
A = for convenient quantum normalization); 

so, Aj=l (or another constant) for all (Var- 
ious possibilities of amplitude and phase modulation 

■"^The k^^ mode of the photon has momentum and energy 
E^; h is Planck's constant; i = 



3 Computational experiments 

The purpose of these experiments is just to verify the 
theory on those basic aspects of the real quantum 
processing which can be simulated. Real quantum- 
physical systems provide performance (much) beyond 
what has been simulated by us up to now, and beyond 
what is simulable at all. 

All experiments were done on a Pentium-4 1.3- GHz 
PC using the following algorithm programmed in Mat- 
Lab with Image Processing Toolbox: 

-^k 

• P images with index k were encoded into v = 
('uf , i)^) where a pixel's greyness is described 
by [0,255] (j = 1, TV). 
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Figure 1: Plots of Peak Signal-to-Noise Ratio of reconstructed image from "query-image" versus 
number of simultaneously-stored images of (left) Chinese pictograms and (right) fingerprints, where 
(left) query is a Chinese pictogram with salt-and-pepper noise, and (right) query is an occluded fingerprint 
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Figure 2: (a) An original image, (b) Original image (a) with 60% salt-and-pepper noise. (c)-(g) Image 
restored from memory of 10 different simultaneously-stored fingerprints after presentation of the "query-image" 
which is: (c) whole original image (a); (d) 25%-occluded image (a); (e) 50%-occluded (a); (f) 75%-occluded 
(a); (g) noisy image (b). 



• Images were preprocessed according to: = — 

XljLi each /c, j. The resulting vector 

was then normalized to satisfy = 1- 

Such normalized are assumed to be quantum- 
implemented into plane- wave/laser-beam ij)^ . 

• Memory matrix, Eq. (1), was calculated {^^ storage 
stage" ) . 

• Later, in the selective reconstruction stage", a 
new "query / recall- key" input was inserted. The 
network reacted as described in Eq. (3), or equiv- 
alently in Eq. (6). The "query-input" was com- 
pleted (if partial initially) or corrected (if cor- 
rupted) based on memorized examples, and scaled 
back into [0,255]-range. 

Quality of reconstructed image v was measured with 
Peak Signal-to-Noise Ratio (in dB; for 255 grey- values): 
PSNR = 20 1ogio (^) ; 

RMSE = \J — ^^^original _ ^reconstructed^2 

We found that reconstruction- quality only slightly 
decreased with increasing number of images stored si- 
multaneously^ and that this behavior was similar re- 
gardless of the type of stored images and the type and 
rate of deviation of the query-image from the stored 
images. For two examples see Fig. ^ Compare these 
plots with Fig. 13 which demonstrates examples of "im- 
age recovery" from occlusion or noise. Indeed, the ca- 
pability of selective reconstruction using memory is al- 



most the same for different rates of degradation (occlu- 
sion or corruption with noise) of the query-image or its 
deviation from the original stored image (s). 

The performance is indeed holography-like — a small 
part of a hologram contains enough information about 
the whole pattern (stored in the hologram, our Eq. 
(5), in a parallel-distributed way) that the whole can 
be retrieved from the small part. 

As evident from Fig. [21 the image which shared 
most pixels with the query-image, was selected from 
memory-matrix and reconstructed ("recognized"), be- 
ing disrupted (merely) by cross-talk due to non- 
orthogonality of stored images. Such results, typical 
for associative nets and holography, were got also in 
the "mixed-set experiment" (Fig. Here, 3 very- 

different sets of 10 different-content images, i.e. with 
big inter-set differences and small intra-set differences, 
were simultaneously stored. Cross-talk backgrounds 
can be seen in Figs. Ol^d-f), but the reconstructed im- 
ages are not disrupted too much. 

4 Conclusions 

Our simulations confirm Hopfield- net's capabilities. 
The novelty of our simulations is reconsideration of 
Hopfield- net's characteristics in the age of powerful 
computers - early simulations of the eighties had a lim- 
ited resolution of patterns rather than images. More- 



Figure 3: Reconstruction from 30 simultaneously-stored images (10 different Chinese pictograms and 10 different 
fingerprints as on Fig. 2(a) and 10 different face-poses like on (a)&(b): "Query" (c) triggers reconstruction 
(d). (e)&:(f) Reconstructions from 25%- and 50%-occluded " query" -pictogram. 



over, our original proposal of quantum- wave imple- 
mentation opens a possibility of nets having up to al- 
most infinite size, and of processing of huge / high- 
resolution images. Therefore, Hopfield- net's cross-talk 
and storage limitations do not manifest (too) much 
for our practical needs. The first problem, cross-talk, 
is reduced since images with a huge number of pixels 
are usually almost orthogonal. The second problem, 
memory- capacity of the Hopfield model is limited (to 
P = 0.14A^), is much reduced with possibility of "astro- 
nomically big" N. Since databases include limited-size 
images, we have not yet been able to demonstrate the 
benefits of (quantum) huge-image processing, but they 
are evident even from classical holography |2l . 

Instead of plane-waves, images could be encoded 
into Gabor wavelets ^21 which are similar to quan- 
tum wave-packets. Other possible (great) improve- 
ments will be studied in the future. 

Our proposal is enormously superior to other 
proposed quantum associative memories |21 El Gl El, 
based on the mainstream of the quantum computing 
science using quantum-implemented logic gates, in the 
sense of simplicity, miniaturization, natural physical 
realizability of associative processing, memory capac- 
ity and dimensionality of data (specifically, size and 
resolution of images). Models [21 01 EE! are, however, 
more compatible with the mainstream attempts for an 
universal-purpose quantum computer, not merely for 
associative tasks which our model masters. 
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